Personalized sound management and method

ABSTRACT

A personalized sound management system for an acoustic space includes at least one transducer, a data communication system, one or more processors operatively coupled to the data communication system and the at least one transducer, and a medium coupled to the one or more processors. The processors access a database of sonic signatures and display a plurality of personalized sound management applications that perform at least one or more tasks among identifying a sonic signature, calculating a sound pressure level, storing metadata related to a sonic signature, monitoring sound pressure level dosage levels, switching to an ear canal microphone in a noisy environment, recording a user&#39;s voice, storing the user&#39;s voice in a memory of an earpiece device, or storing the user&#39;s voice in a memory of a server system, or converting received text received in texts or emails to voice using text to speech conversion. Other embodiments are disclosed.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation of and claims priority benefit toU.S. application Ser. No. 17/203,731, filed 16 Mar. 2021, which is acontinuation of U.S. application Ser. No. 16/671,689, filed 1 Nov. 2019,which is a continuation of U.S. application Ser. No. 14/846,994, filed 7Sep. 2015. U.S. application Ser. No. 14/846,994 is a continuation ofU.S. application Ser. No. 12/560,097 filed on 15 Sep. 2009 and claimsthe benefit of U.S. provisional patent application No. 61/098,914 filed22 Sep. 2008. The disclosure of the aforementioned applications are allincorporated herein by reference in their entireties.

FIELD OF THE INVENTION

The invention relates in general to methods of managing sound, andparticularly though not exclusively, is related to personalized soundmanagement.

BACKGROUND OF THE INVENTION

The world of two hundred years ago is substantially different than thepresent day earth. Similarly, the acoustic environment that surrounds usis also changing. For example, the sounds of a large city have changedas the mode of transportation transitioned from walking and horse andbuggy, to cars, subways, and airplanes.

In general, humans are continuously inundated by a diversity of sounds.Many of the sounds are not critical to our lives but our brain processesthese sounds and tries to distinguish between them. Background soundlevels can also make it difficult to hear sounds that are important. Toomuch acoustic information can cause an auditory overload that can impactboth the health and safety of an individual.

SUMMARY

The invention relates in general to methods and system for implementinga suite of personalized sound applications for modifying a user'sacoustic environment and more particularly, though not exclusively, tofacilitating the adoption of the technology, ensuring the technologyfunctions properly, protecting both the manufacturers and consumer, andproviding user selection and control over the management of sound.

At least one exemplary embodiment is directed to a method ofpersonalized sound management comprising the steps of: selecting atleast one of a plurality of personalized sound management applicationsthrough a client system where the user selects the at least one of theplurality of personalized sound management applications from a website;accepting a subscription contract for using the at least one of thepersonalized sound management applications; and loading the selected atleast one of the plurality of applications from a server system to adevice where the device has at least one microphone, at least onespeaker, and a processor configured to identify sonic signatures whereeach sonic signature is identified using a Gaussian mixture model.

At least one exemplary embodiment is directed to a method ofimplementing personalized sound management comprising the steps of:recording sound with a microphone of a communication device; analyzingthe sound for acoustic information relevant for personalized soundmanagement applications; storing a sonic signature in a memory of thecommunication device; calculating a sound pressure level of the sonicsignature; and attaching and storing metadata related to the sonicsignature and sound pressure level including a time stamp and geocode.

BRIEF DESCRIPTION OF THE DRAWINGS

Exemplary embodiments of the present invention will become more fullyunderstood from the detailed description and the accompanying drawings,wherein:

FIG. 1 illustrates a block diagram of the interaction of personalizedsound management in accordance with at least one exemplary embodiment;

FIG. 2 illustrates a block diagram of a partial list of applications forpersonalized sound management in accordance with at least one exemplaryembodiment;

FIG. 3 illustrates a block diagram of the interaction of a personalizedmanagement enabled device with other devices in accordance with at leastone exemplary embodiment;

FIG. 4 illustrates a flow chart of a process of providing personalizedsound management in accordance with at least one exemplary embodiment;

FIG. 5 illustrates a flow chart of an application testing in accordancewith at least one exemplary embodiment;

FIG. 6 illustrates a flow chart of the testing of a personal soundmanagement device in accordance with at least one exemplary embodiment;

FIGS. 7a and 7b are diagrams illustrating a consumer purchase process inaccordance with at least one exemplary embodiment;

FIG. 8 illustrates a flow chart of registering a new device thatincludes personalized sound management applications in accordance withat least one exemplary embodiment;

FIG. 9 illustrates a flow chart of enabling the new device in accordancewith at least one exemplary embodiment;

FIG. 10 illustrates a flow chart of updating a unit or device inaccordance with at least one exemplary embodiment;

FIG. 11 illustrates a diagram of a device for implementing personalizedsound management in accordance with at least one exemplary embodiment;

FIG. 12 illustrates a block diagram of a device for implementingpersonalized sound management in accordance with at least one exemplaryembodiment;

FIG. 13 illustrates a diagram of a communication device or earpiececonfigured to provide sonic signatures to a sonic signature database inaccordance with at least one exemplary embodiment; and

FIG. 14 illustrates a block diagram of a cell phone capturing a sonicsignature and providing the sonic signature to a database of sounds inaccordance with at least one exemplary embodiment.

DETAILED DESCRIPTION OF EXEMPLARY EMBODIMENTS OF THE PRESENT INVENTION

The following description of exemplary embodiment(s) is merelyillustrative in nature and is in no way intended to limit the invention,its application, or uses.

Processes, techniques, apparatus, and materials as known by one ofordinary skill in the art may not be discussed in detail but areintended to be part of the enabling description where appropriate. Forexample specific computer code may not be listed for achieving each ofthe steps discussed, however one of ordinary skill would be able,without undo experimentation, to write such code given the enablingdisclosure herein. Such code is intended to fall within the scope of atleast one exemplary embodiment.

Additionally, the sizes of structures used in exemplary embodiments arenot limited by any discussion herein (e.g., the sizes of structures canbe macro (centimeter, meter, millimeter, micro (micro meter), nanometersize and smaller).

Notice that similar reference numerals and letters refer to similaritems in the following figures, and thus once an item is defined in onefigure, it may not be discussed or further defined in the followingfigures.

In all of the examples illustrated and discussed herein, any specificvalues, should be interpreted to be illustrative only and non-limiting.Thus, other examples of the exemplary embodiments could have differentvalues.

FIG. 1 is a diagram of personal sound management in accordance with atleast one exemplary embodiment. In our global community 100, each personis unique. The differences between individuals can be genetic, cultural,environmental, personal, or physical to name just a few. The combinationof these traits is what makes us unique. One of the main senses a humanrelies on is our auditory sense. Hearing impacts every aspect of ourlife from communication to safety. How each individual perceives anduses sound is also unique.

From an acoustic perspective, sound pressure levels have been risingsteadily. The diversity of sounds is also increasing. The human braincontinuously processes the acoustic information provided by the ears.Both the sound pressure levels and the sound diversity puts increasingstrain on a person to determine what they need to hear versus what theyare hearing. Ultimately, this “acoustic overload” can manifest itself inphysical ailments and health risks such as stress, sleeplessness, anddepression.

A person 102 has an acoustic space 104 from which a majority of soundsthey receive emanate. Some of the sounds are useful to person 102 andsome sounds may have no use. Acoustic space 104 can be large or small.Acoustic space 104 will change with time and location. For example,acoustic space 104 can be a room, a stadium, a forest, an automobile, aplane, or the ear canal of person 102. Personalized sound management(PSM™) 106 is the ability to modify what is received from acoustic space104 thereby tailoring or personalizing the received acoustic informationto meet the needs of person 102.

Devices 108 are a source of acoustic information within acoustic space104. In general, device(s) 108 have a speaker, a microphone, or one ormore of both. In general, application hardware and software 110 isincorporated in, although can be external also, device(s) 108 to allowpersonalization of acoustic space 104. Person 102 selects theapplications and controls device(s) 108 to modify acoustic space 104 tomeet their personal needs and wants. The benefit and utility ofpersonalizing and managing sound received by person 102 will bedisclosed in more detail.

FIG. 2 is a diagram illustrating a partial list of applications forpersonalized sound management in accordance with at least one exemplaryembodiment. A user 202 has an acoustic space 204 that includes both realsounds and potential sounds. In many cases, acoustic space 204 can beinundated with a variety of sounds not under control of user 202. Thislack of control over acoustic information and sound within acousticspace 204 can make for a reduction in quality of life, loss ofefficiency, or more seriously affecting user's 202 health and safety.

In at least one exemplary embodiment, a user 202 selects 201 at leastone personalized sound management application from a personalized soundmanagement applications list 206. Although only a partial list,applications such as Safe Space™ 216, EarGuard™ 218, Quiet Call™ 220,Ear Sticky™ 230, Hearable™ 222, Always On-Recording™ 224, Earbliss™ 226,Hear & Tell™ 232, and Ear Mai™ 228 will be used to illustrate howacoustic space 204 is personalized and managed for the benefit of user202. A more detailed explanation of personalized sound managementapplications 206 will be described.

The selected applications of user 202 are loaded into ROM 212. Anoperating system 208 is configured operably with device 210 and ROM 212.Operating system 208, in conjunction with personalized sound managementapplications 206, provides an interface to the user for personalizedsound management 214 to meet user needs to manage user acoustic space202 and for controlling device 210.

ROM 212 can be read only memory such that the selected applications frompersonalized sound management list 206 cannot be tampered with orrewritten. However in at least one exemplary embodiment ROM 212 can alsobe memory that can be read and written to so that a user can changesettings. Alternately, ROM 212 can be other types of memory such asfe-ram, phase change memory, magneto-resistive memory, hard drive, sram,dram, eprom, eeprom, and other non-volatile or read only memories wherethe selected applications are secure from any type of downloading,tampering, or modification through physical or software protection.Monitoring of ROM 212 and the selected applications can also be addedwhere notification is sent or device 210 is disabled when an improperaction is detected. ROM 212 ensures that an application will operate asdisclosed for user 202.

Components of device 210 can be built in a single unit or operativelycoupled units. For example, multiple devices of 210 can be wired,optically connected, wirelessly connected or a combination thereof.Operating system 208 can be run remotely to operate device 210 or residewithin device 210. Similarly, ROM 212 can be located in device 210 orremote to device 210. In at least one exemplary embodiment, operatingsystem 208 resides in ROM 212. Device 210 typically has at least onemicrophone or at least one speaker, or both. The at least one microphoneprovides acoustic information for use in conjunction with personalizedsound management applications. The at least one speaker providesacoustic information to user 202 and acoustic space 204. Device 210 hasa microprocessor (not shown) for running applications 206. In at leastone exemplary embodiment the microprocessor is dedicated to runningpersonalized sound management applications 206.

In general, personalized sound management applications are customizablepoint solutions that allow user 202 to handle a variety of tasksassociated with managing acoustic space 204. The selection ofpersonalized sound management applications will depend on the person,the device, and the acoustic space being managed. Non-limiting examplesof devices that can use personalized sound management applications withthe appropriate hardware and operating system, are earpieces, mediadevices, and vehicles.

Described hereinbelow are brief overviews of the user selectedpersonalized sound management applications:

Safe Space™ 216 is an “intelligent hearing” application that detects andoutputs a response based on the identification of a recognized sound.The concept of recognizing sounds is described as Sonic SignatureDetection. Safe Space™ 216 also includes a user defined hierarchy andcan provide responses based on the hierarchy.

A brief example is provided of how Safe Space™ 216 manages the acousticspace corresponding to the interior of an automobile. As is well known,automobiles are designed to have a quiet interior space. Soundinsulation is deliberately placed around the car interior to attenuatesounds coming from the car exterior. Furthermore, automobile driversoften listen to high volume music while driving. This combination makesit difficult to hear sounds such as emergency vehicles. People often getseriously injured because they hear the emergency vehicle when it is inclose proximity to the vehicle and panic causing an accident. Alldescriptions below describing personalized sound management applicationsassume that the device using the application has incorporated within itthe hardware and software required to run the application and performthe application function.

In this example, Safe Space™ 216 detects emergency vehicle horns whenthey are a substantial distance away. In at least one exemplaryembodiment, a microphone is exterior to the car and can pick up soundsin the ambient or car exterior. Sonic signatures related to emergencyvehicles such as fire trucks, ambulances, and police cars are stored inthe system. Safe Space™ 216 analyses sounds from the microphone. Aresponse is provided if one of the stored sonic signatures is detected.In at least one exemplary embodiment, upon detecting a fire truck siren,Safe Space™ 216 can initiate playing the identified signal through thecar stereo system for the car driver to hear and respond to. In at leastone exemplary embodiment, Safe Space™ 216 can calculate the direction,distance, and street (through GPS) of the approaching emergency vehicle.The information is then provided visually or vocally to the driver. Forexample, the car stereo automatically turns down the music and statesthrough the speaker system that an ambulance is coming east bound on3.sup.rd Street or an ambulance is approaching from the right.

EarGuard™ 218 is a personalized sound management application thatimproves listening quality and safety. Hearing disorders are increasingat a very high rate. Many people live in an environment such as a noisyurban environment or an industrial manufacturing area where soundpressure levels are consistently high. Moreover, people themselves aresubjecting themselves to loud and sustained sounds. Examples of extremeor sustained sound exposure are portable media players using earbuds,sport shooting, and rock concerts. The trend is a growing population ofpeople that have or will have hearing problems.

The ear is a very sensitive instrument having a large dynamic range thatallows us to hear sounds ranging from a whisper to a shout. Subjectingthe ear to man-made cacophony is now known to metabolically exhaust thehighly specialized sensory cells in the inner ear, causing them to dieand be replaced by scar tissue in the hearing organ. Ear Guard™ 218 isan application that monitors the sound exposure of the user and protectsthe ear from damage.

Briefly, Earguard™ 218 improves listening quality and safety byemploying a personal hearing zone that measures sound levels within theear and in one exemplary embodiment an intelligent level control toprotect against over amplification. Earguard™ 218 includes a soundpressure level (SPL) dose management system. The SPL dose managementsystem takes into account both transient and long term sound. In atleast one exemplary embodiment, when sound at the user's eardrum isabove a certain threshold known to begin the process of metabolicallyexhausting the ear, the metric known as SPL Dose increases. The SPL dosedecreases when sound is below that threshold according to a recoveryfunction that mirrors the recovery of the ear from excessive soundexposure. In at least one exemplary embodiment, Earguard™ 218 willindicate to the user damage to the ear is likely if the sound exposureis continued. In this scenario, the user has the control to take theappropriate action to protect his/her ears.

In at least one exemplary embodiment, an intelligent level adjustmentsystem is a personalized sound management application that automaticallyestimates the preferred listening level of an audio content signal (e.g.speech or music audio from a device) depending on an analysis of thelevel, other acoustic features of the ambient environment, and ananalysis of the audio content signal. Thus, a human-machine relationshipis nurtured with this bi-directional control flow from human to theintelligent level adjustment system and from intelligent leveladjustment system to the human user.

A substantial benefit of an application such as Earguard™ 218 is theprotection of the ear from damage. Furthermore, this safeguard ifpropagated will prevent hearing loss thereby reducing the financialburden on the economy in years to come for the individual, business, andgovernment for hearing loss remedies. Thus, using Earguard™ 218 couldnot only stem the growth in hearing related problems but greatly reduceit over the years to come.

Quiet Call™ 220 is an application that allows user 202 having heard avoice message to respond to the remote caller through a non-verbalmeans. An example of a non-verbal response is a key-pad entered textmessage. The entered text message is converted to a speech audio messageand is sent to the remote caller. The caller then receives the speechaudio message.

An example of the utility of Quiet Call™ 220 is illustrated when user202 is in an important business meeting but is required to provide inputto another remote meeting. User 202 receives the voice message sent fromsomeone in the remote meeting. User 202 responds by entering theresponse through his/her phone keypad; the text is converted to voiceand sent to the person at the remote meeting who sent the originalmessage. User 202 does not have to interrupt the meeting to listen tothe voice message nor to reply. Thus, the meeting attended by user 202can move forward with little or no loss of momentum that would occur ifthe meeting was disrupted by the call.

Hearable™ 222 is a speech enhancement application that improves voicecommunication. For example, Hearable™ 222 can be used with an earpiecedevice having at least two microphones, an ambient sound microphone forreceiving sounds in the ambient environment and an ear canal microphonefor receiving sounds in the ear canal. A common use for the earpiecewould be with a communication device such as a cell phone or other phonesystem. The earpiece using the Hearable™ 222 application would normallyuse the ambient sound microphone for receiving and transmitting theuser's spoken voice. In this mode, the user's voice will be naturalsounding and easily recognizable on the receiving end.

In a noisy environment it can be difficult to carry on a telephoneconversation. The ambient sound microphone will pick up the voice andthe noise in the ambient environment. The earpiece will switch to theear canal microphone when the ambient sound microphone detects a highbackground noise level. The user's voice is readily picked up by the earcanal microphone but the noise in the ambient environment issubstantially reduced. Switching to the ear canal microphone allows thereceiving party to clearly hear the user's voice. The problem with usingthe ear canal microphone is that user's voice received in the ear canalsounds different because of frequency roll off in the upper spectrum ofthe voice range. Although the user can be heard clearly, the user'svoice may not sound right to the receiving end.

Hearable™ 222 is a personalized sound management application thatimproves the sound quality of the user's voice. Hearable™ 222 uses acombination of the sound received by the ambient sound microphone andthe ear canal microphone to create a more natural sounding voice. Thecombination of the two signals is a function of the background noiselevel. Explaining further the signal from the ambient sound microphoneis used less as the background noise level increases. Hearable™ 222allows a user to have a conversation in a noisy environment whileproviding a high quality voice signal that is intelligible andrecognizable at the receiving end.

Always On-Recording™ 224 is a personalized sound application that actsas its name implies. A device using the Always On-Recording™ 224application is recording the most current audio information for userrecall. The recording is stored in a buffer that will allow the user toimmediately access the audio information. The buffer will have a finiteamount of storage. The recording time will be a function of the bufferor memory available for the Always On-Recording™ 224 application.

Always On-Recording™ 224 provides utility for short durations ofrecording. For example, in an application where a user is receivinginformation such as a phone number or driving directions. The user knowsthat the device employing Always On-Recording™ 224 has the storedacoustic information and can immediately listen-again to the buffercontents thereby repeating the phone number or driving directions.Similarly, if the user was discussing a contract term and wanted to knowexactly what the person said, the user could immediately re-listen tomake sure that what they thought they heard is exactly what they heard.

Earbliss™ 226 is a personalized sound management application to provideacoustic isolation from someone who snores while allowing other soundsto be heard. A large percentage of the population suffers thoughsleepless nights because of the sounds generated by people with sleepapnea and more generally due to loud snoring. Moreover, sleepdeprivation can have serious consequences related to health anddisposition.

Earbliss™ 226 is a sleep zone technology that utilizes sonic signaturedetection to insulate sleep partners against intrusion from snoringwhile still providing awareness of priority sounds. In this example, asonic signature is acoustic information related to the sounds of aperson snoring. In at least one exemplary embodiment, Earbliss™ 226 isan application that is used in conjunction earpieces.

Sealing the ear canal with ear plugs will attenuate the snoring but alsoblocks out all sounds. Hearing is one of the most vital senses that wehave. Under normal conditions we cannot turn off our hearing whichallows us to wake in a critical situation. Ear plugs will block outsounds of consequence. For example, the user may not hear their babycrying or a child leaving their room.

Earbliss™ 226 enables a user to attenuate snoring while hearing othersounds around them. The earpieces fit in the ear canal of the user toseal or partially seal the ear canal. The earpieces have an ambientsound microphone for receiving acoustic information from the ambientenvironment and an ear canal receiver for providing sound to the user'sear canal. As mentioned previously, the earpieces will have a sonicsignature related to snorer's snoring stored in memory in the device.

The ambient sound microphone picks up all sounds in the ambientenvironment including the snorer's snoring. The earpiece processes allthe acoustic information coming from the ambient sound microphone andlooks for signals similar to stored sonic signatures. Patternrecognition approaches are applied based on the known sonic signaturesto detect the snoring sounds from their corresponding sonic signatures.More specifically, sonic signatures can then be compared to learnedmodels to identify a corresponding snoring sound. Once identified thesnoring sound is suppressed and not output to the ear canal by the earcanal receiver. Thus, the wearer of the earpieces does not hear thesnoring.

Conversely, sounds in the ambient environment that are not recognizedthrough the processing of acoustic information by the earpieces can bepassed transparently to the ear canal receiver for reproduction withinthe ear canal. In this mode, the sound produced in the ear canalsufficiently matches the ambient sound outside the ear canal, therebyproviding a “transparency” effect other than the suppressed sonicsignature (snoring). The earpieces can also enhance sound. For example,the earpieces having sonic signatures related to a fire truck siren or ababy crying can detect either signal and then amplify the signal (firetruck siren, baby crying) so as to make the wearer of the earpiecesaware of the signal's detection. Thus, Earbliss™ 226 modifies theacoustic environment of the user to eliminate what does not need to beheard while allowing the user to be aware of other sounds in a normalcontext.

Ear Mail™ 228 is a personalized sound management application forconverting text to voice. In particular, Ear Mail™ 228 provides greatutility to users of email and text messaging although not limited tothese examples. Email and text messaging is becoming a very popular formof communication among a large portion of the population. It is notalways convenient or in some cases not prudent to review written textdepending on the situation.

Ear Mail™ 228 converts the text of a message or email to a speech audiomessage using a text to speech algorithm. The converted speech audiomessage is replayed through a loudspeaker coupled to a device using theEar Mail™ 228 application. For example, Ear Mail™ 228 used in a smartphone coupled to the stereo system of a car through a blue toothconnection could playback the text or emails through the car speakers.The user could hear their messages while driving safely down the road.

Ear Sticky™ 230 is a personalized sound management application forrecording information that can be saved and used for future use. In atleast one exemplary embodiment, Ear Sticky™ 230 is a mobilecommunication application that can be used in a device such as a cellphone or an earpiece that is operably coupled to other devices. EarSticky™ 230 can record communication through a device or sounds in theambient environment. Sounds in the ambient environment are recorded byan ambient sound microphone.

In a first example of an Ear Sticky™ 230 application, a conversationbetween a husband and wife occurs and a list of items to pick up atseveral stores is disclosed. The user of Ear Sticky™ 230 does not needto write down or remember this list. The conversation is being recordedand stored in a buffer. The user activates Ear Sticky™ 230 to store therecorded conversation to be reviewed at a later time. Thus, the user ofEar Sticky™ 230 could recall and listen to the list on the way home toensure that the right items are picked up at the appropriate store.

In a second example of an Ear Sticky™ 230 application, a device recordswith an ambient sound microphone. For example, the user of Ear Sticky™230 comes up with a great concept to solve a problem he or she has beenworking on for some time. The user can enable Ear Sticky™ 230 and usesthe ambient sound microphone to record his or her voice to convey theidea, concept, or thoughts and store it for review at a later time. Ingeneral, Ear Sticky™ 230 provides utility and convenience in storing andrecalling sounds in one's acoustic space.

Hear & Tell™ 232 is a personalized sound management application forrecording a sound, training a Gaussian mixture model to learn featuresof the sound and then storing the Gaussian mixture model in memory ofthe device. A user of Hear & Tell™ 232 can record the sound or provide asound, called herein as a sonic signature. The device is operablycoupled to at least one microphone to compare sounds received from themicrophone against the stored sonic signature. The device can perform anoperation that modifies the user's acoustic space 204 once a sound isidentified as being similar to a sonic signature. Examples of severaloperations the device can perform are passing the detected signalthrough to the user, boosting the sound such that the user is made awareof the detected sound, rejecting the sound so the user does not hear thedetected sound, attenuating the detected sound, and replacing thedetected sound with an alternate sound to name.

The Hear & Tell™ 232 application will store a Gaussian mixture model(GMM) for every sonic signature that it has been trained to recognize.Each GMM is completely specified by a mixture of mean vectors, a mixtureof covariance matrices, and a mixture of weights.

An example of a warning sound (e.g. siren of emergency vehicle) will beused to further illustrate the Hear & Tell™ 232 learning application.Each GMM provides a model for the distribution of the feature statisticsfor each warning sound in a multi-dimensional space. Upon presentationof a new feature vector, the likelihood of the presence of each warningsound can be calculated. In at least one exemplary embodiment, eachwarning sound's GMM is evaluated relative to its anti-model, and a scorerelated to the likelihood of that warning sound is computed in order todetermine if a sound is detected. A threshold can be applied directly tothis score to decide whether the warning sound is present or absent.Similarly, a sequence of scores can be relayed and used in a morecomplex rule set to determine absence or presence of the sound. Thus,Hear & Tell™ 232 allows a user to store, model, and train a device forsonic signatures under user control and selection thereby allowing auser to modify their acoustic space through the detection of a sound andresponse by the device.

In general, personalized sound management applications are customizablepoint solutions that allow user 202 to handle a variety of tasksassociated with managing acoustic space 204. The selection ofpersonalized sound management applications will depend on the person,the device, and the acoustic space being managed. Examples of devicesthat can use personalized sound management applications with theappropriate hardware and operating system, but not limited to theseexamples, are earpieces, media devices, and vehicles.

As described hereinabove, a suite of personalized sound managementapplications 206 are provided. The user 202 can select the desiredapplications and have control over their acoustic space 204. Theselected applications are stored in ROM 212. Under user control, user202 selects the parameters of personalized sound management applications206 using operating system 208 for implementing applications 206 indevice 210 for managing acoustic space 204 based on the individual'sneeds and wants.

FIG. 3 is a diagram illustrating a module 300 for implementingpersonalized sound management in accordance with at least one exemplaryembodiment. Module 300 comprises an H-Chip™ 302, a ROM 304, an operatingsystem 306, and user selected personalized sound management applications308. In at least one exemplary embodiment, module 300 comprises theH-Chip™ 302 with ROM 304 built into H-Chip™ 302. Both operating system306 and user selected personalized sound management applications 308 arestored on ROM 304. Alternately, H-Chip™ 302 and ROM 304 can be separatechips allowing for a larger block of memory.

H-Chip™ 302 is a microprocessor, DSP, or logic circuit that implementspersonalized sound management applications 308. H-Chip™ 302 is optimizedfor low power dissipation while running user selected personalized soundmanagement applications 308. In at least one exemplary embodiment,H-Chip™ 302 can be a dedicated engine for running applications 308.

Module 300 comprises an application engine (firmware) and a dedicatedprocessor that simplifies the integration of user selected and usercontrolled personalized sound management applications 308 into a device.In an exemplary embodiment, module 300 is integrated into each device indevices 314. Devices 314 typically, although not always have at leastone microphone and at least one speaker. User 310 in conjunction withmodule 300 can personalize how each device manages sound to the user.

An additional aspect of module 300 is that a third party manufacturermerely builds the acoustic portion of their device around module 300. Inan exemplary embodiment, a manufacturer does not and cannot modifyoperating system 306 and user selected personalized sound managementapplications 308. Thus, the manufacturer saves time, effort, and moneythrough the seamless integration module 300 into a single hardwaresolution for maximum transportability into 3.sup.rd party form factors.

FIG. 4 is a diagram illustrating a process of providing personalizedsound management in accordance with at least one exemplary embodiment.In general, the technology related to providing personalized soundmanagement comprises hardware components and software. In at least oneexemplary embodiment, the hardware 402 comprises transducers 404 andH-Chip™ 406.

Transducers 404 are speaker and microphones for respectively providingand receiving sound in an acoustic space. Depending on the application,the size and form factor of transducers 404 may be a critical designparameter. Transducers 404 can be a speaker for providing high fidelitysound to enhance a user's experience. Similarly, transducers 404 can bea microphone for receiving acoustic information and in some cases canpick up sounds inaudible to the user.

H-Chip™ 406 can be a microprocessor, digital signal processor, logiccircuit, or applications specific integrated circuit for useimplementing the software applications listed hereinabove and otherprograms related to personalized sound management. H-Chip™ 406 includesoperating system 408 specific for managing the device as it relates topersonalized sound management and allows user control to adjust theparameters of each application for their specific needs.

Hardware 402 can be integrated into existing devices or next generationdevices for adding utility, providing safety, and allowingpersonalization of a user's acoustic space. Providing hardware 402enables device manufacturers 410 to rapidly integrate the technologyinto their products. This will quicken the adoption cycle of thetechnology for the benefit of the general public in health and safety,and for the individual through personalization. Hardware 402 can be acircuit board to which transducers 404 and H-Chip™ 406 are operativelyattached.

Device manufacturers 410 can provide their own hardware 414 or usetransducers 404 and H-Chip™ 406. The operating system and applicationsoftware is incorporated 412 and stored in read only memory (ROM). In atleast one exemplary embodiment, operating system 408 and the applicationsoftware can be stored in ROM. Using read only memory for storageprevents device manufacturers 410 or consumers from tampering with thesoftware code thereby maintaining the integrity of the system and how itperforms for the user. Note herein when referring to ROM storage, atleast one exemplary embodiment can include RAM or other read/writestorage methods.

People in the consumer product industry have stated that any new productand even old products in the hands of consumers may produce liabilityissues that companies associated with the product have to deal with.This often delays an introduction of a product or adds substantial costto a product launch. In at least one exemplary embodiment, devicemanufacturers 410 provide their product for certification 416. In atleast one exemplary embodiment, certification 416 is performed by anindependent company from device manufacturers 410. Certification 416 isa process whereby a new product is exhaustively tested to ensure thedevice will perform to specification under a variety of conditions andtolerances. In particular, certification 416 tests the operating systemand the device performance in implementing the applications related topersonal sound management. Should the device not pass certificationtesting, it can be repaired or redesigned. The repaired or redesigneddevice can then undergo certification 416 to determine if it meets thetest specifications.

In at least one exemplary embodiment, an insurance policy 418 may beprovided covering the device manufacturers 410 using operating system408, hardware 402, and the application software. This providessubstantial benefits in that the device manufacturers 410 can deploy thetechnology with less risk. Moreover, each company providing devices willknow that the personalized sound management system is similar oridentical to others in the market. As mentioned hereinabove, theoperating system and application software can be stored in ROM ensuringit cannot be rewritten. Additional measures can be taken to determine ifthe software is being used out of context and shutting down theoperation of the device.

Once tested and certified, device manufacturers 410 can manufacture,market, and sell devices with personalized sound management 424 and becovered from a liability perspective under provisions in the insurancepolicy 418. A consumer purchases 420 a certified device and may also becovered under the same insurance policy 418 or may have a second policydirected to the consumer. Consumer protected 422 under insurance policy418 and having certification 416 will instill consumer confidence to thequality and reliability of the device. This will be discussed in greaterdetail hereinbelow. Thus, this process is very efficient in creatingmanufacturer adoption of the personalized sound management technologywhile protecting both device manufacturers 410 and the consumer.

FIG. 5 is a diagram illustrating application testing in accordance withat least one exemplary embodiment. Device manufacturers 502 develop,prototype, and manufacture products 506. Products 506 include hardwareand operating system 504 for running and performing Personalized SoundManagement (PSM™) applications 508.

In at least one exemplary embodiment, hardware and operating system 504is capable of running all personalized sound management applications508. Products 506 may or may not use all of personalized soundmanagement applications 508. Similarly, an end user or customer ofproducts 506 may or may not use all of personalized sound managementapplications 508.

Hardware and operating system 504 of products 506 are loaded with allpersonalized sound management applications 508. The hardware andoperating system 504 are exercised in testing 510 to ensure that it canrun personalized sound management applications 508 per specification.Product 506 may or may not be tested for all personalized soundmanagement applications 508 depending on the capability of the device.Products 506 will be tested 510 for the implementation of allpersonalized sound management applications it is capable of running tomeet user specifications for the product (i.e. product certification512). In at least one exemplary embodiment, should a product run only asubset of personalized sound management applications, the product can bedesigned and tested to lock out the running of applications notspecified for the particular product (even though hardware and operatingsystem 504 can run personalized sound management applications 508).

A scale of economy for developing and manufacturing hardware andoperating system 504 is achieved by having a number of different devicemanufacturers 502 standardize on the engine (hardware and operatingsystem 504) for implementing personalized sound management. Consistencyof product, ability to expand scope of product, and lowering costthrough volume manufacturing are all achieved by this methodology. Inthe example where liability insurance may be purchased by the productcertification company (or other company) testing 510 all personalizedsound management applications 508 in products 506 ensures that hardwareand operating system 504 perform per specification independent of theproduct it is placed in. Furthermore, having little or no variation onthe operation of hardware and operating system 504 and personalizedsound management applications 508 minimizes risk. An added benefit isthat a large statistical database of diversified products is generatedthat will allow improvements to managing personalized sound managementdevices to improved device performance as well as lower liability risk.The consumer benefits by having a highly exercised and stable productthat improves their health, safety, and quality of life.

FIG. 6 is a diagram illustrating testing of a personalized soundmanagement product 602 in accordance with at least one exemplaryembodiment. In at least one exemplary embodiment, testing of allproducts incorporating personalized sound management applications aretested by a single entity. Personalized sound management product 602 canbe developed and manufactured by a number of different companies. Aspreviously mentioned, this allows the single entity, should it so desireto purchase a liability insurance policy that covers the manufacturersmaking personalized sound management product 602 and consumers usingpersonalized sound management product 602.

Personalized sound management product 602 is tested by certificationlaboratory 604. In at least one exemplary embodiment, certificationlaboratory 604 is independent from the different manufacturers thatdevelop personalized sound management product 602 thereby providingunbiased testing. Testing 614 of hardware 606, software 608, andmanufacturing 610 are performed on personalized sound management product602. Testing 614 is related to operation and performance of personalizedsound management applications. Hardware testing includes the processor,transducers, and other elements, which implement the personalized soundmanagement of the device. Testing of software 608 includes the operatingsystem and personalized sound management applications. Testing 614includes reliability 616 and quality 618 testing. Testing 614 can alsoinclude human testing because in some embodiments, personalized soundmanagement product may be worn in an orifice of the human body.

Upon passing testing 614 the personalized sound management product 602is certified by certification laboratory 604. A product certified 620can include some form of warranty, indemnification, and liabilityinsurance for the device. Problems or issues with personalized soundmanagement product 602 are reported to the company should it fail forany reasons. Corrective action can be taken and the device retested todetermine if the issue has been resolved.

In at least one exemplary embodiment, certification laboratory 604 orits parent company will brand the product by placing a trademark orcompany logo on the approved personalized sound management product 602.The trademark or logo represents the incorporation of its personalizedsound management technology in the product (hardware, software, andintellectual property) as well as the certification indicating thequality and reliability of the device.

FIG. 7a is a diagram illustrating a consumer purchase process for apersonalized sound management product in accordance with at least oneexemplary embodiment. A consumer reviews a number of different devicessuch as earpieces in a display area. The display area allows theconsumer to look, feel, and touch the hardware. The consumer focuses onan earpiece 701 in the display area and wants to learn more about thedevice.

A sales person can demonstrate earpiece 701 allowing the consumer totest the functions and performance of the device. A demonstration roomor test environment can be used to illustrate performancedifferentiation when compared to other earpieces. In at least oneexemplary embodiment, earpiece 701 is an in-ear device that has aremovable and disposable sealing section. This allows consumer testingusing earpiece 701 while maintaining a sanitary condition by disposingof the sealing section after each test session.

The consumer indicates to the sales person that he or she would like topurchase earpiece 701. The sales person accesses a computer that iscoupled to server system for completing a purchase transaction. Theconsumer provides registration information that is entered into adatabase in a step 703. The consumer or the sales person can enter theinformation into the database. The registration information 705comprises information such as personal, financial, business, andpreference. Personal information relates to data such as age, sex, homeaddress, telephone number, email address, which identifies the consumer.Financial information relates the consumer's ability to pay such ascredit history, credit card for billing, job information, and bankinginstitutions. Business information relates to a business purchase of thecomponent. Similar to above, business identification and businessfinancial information would be entered with the purchase. Preferencesrelate to things such as how the consumer wants to be contacted (email,phone), do they want to be made aware of upgrades for their device, andother products they might have interest in. Other information or userexperiences could also be collected during the registration process.

The unit selected by the consumer is then entered into the system in astep 707. In at least one exemplary embodiment, the system identifiesthe unit and provides a listing of the hardware, software, andsubsystems that work with the earpiece 701. The consumer can look at theoptions available in a step 709 and select among these options. In atleast one exemplary embodiment, the selection process can be facilitatedby topic, occupation, or other characteristics by providing a list oftypical user features applied to earpiece 701. For example, the consumeris purchasing earpiece 701 for a multimedia player. Earpiece 701provides a substantial improvement in noise attenuation, musicalclarity, definition, and dynamic range. The consumer is interested inthe safety aspect (and selects this topic on the kiosk) provided byearpiece 701 in alerting the user to an emergency event. For example,earpiece 701 can detect and make the user aware of sirens, emergencysounds, alarms, etc. that would be difficult to hear when listening tomusic. The consumer by looking at the “safety” topic can selectappropriate applications software and sonic signatures to alert the userof a safety situation for their specific device. The consumer cancontinue to look through other topics and select hardware and softwarethat supplements and implements the desired user experience.

As mentioned previously, the options can be provided in a step 709 inmany different formats. Another format of providing options is byoccupation. For example, a dentist may be provided a package to outfitthe entire office and patients. The earpieces substantially reduce noiserelated to drilling which are both a psychological barrier for dentistryand a hearing loss mechanism for people working in a dentist office. Theoccupation package can provide wireless communication between devicesallowing dentists, assistants, and patients to talk or listen to musiceven in a noisy environment. Replaceable in-ear sealing sections wouldallow the staff to maintain sanitary conditions with each new patient.After reviewing the consumer selects the appropriate hardware andsoftware to personalize their sound space (on the kiosk or computer) ina step 711.

In at least one exemplary embodiment, the selected application softwareprovided to earpiece 701 is a subscription whereby the consumer pays amonthly fee to use the applications. Alternately, the selectedapplication software can be a license or purchase associated with theearpiece 701 whereby a one time fee is paid. The consumer can discussthe terms of the agreement with the sales person or review the contracton the computer. If the consumer approves, the contract is signed oraccepted and an initial payment is made for the hardware and software ina step 713. The consumer can have the subscription payment automaticallybilled to a credit card or other automatic payment methodology to ensureuninterrupted service.

The purchased earpiece is then connected via a wired or wirelessconnection to download the selected software and enabled in a step 715.A wired connection 717 such as a mini USB cable is shown in theillustration. Wired connection 717 connects to a server system havingthe appropriate software. In at least one exemplary embodiment, theselections from step 711 can be stored in memory and used to direct thedownloading of software to the device, verify the software can be usedin the device, and that the appropriate software has been loaded.

FIG. 7b is a diagram illustrating a consumer purchase process for apersonalized sound management product in accordance with at least oneexemplary embodiment. A consumer 702 can purchase personalized soundmanagement product hardware 704 and personalized sound managementapplication software 706. Software 706 works with hardware 704 topersonalize and manage sound for consumer 702 for providing utility,safety, and health benefits.

Hardware 704 can range from a complete product such as a communicationdevice, sound device, or earpiece to ancillary components for enhancingthe look of the device or adding further hardware features. In the eventthat consumer 702 purchases hardware 704, customer information 708 isrequired to continue with purchase. In general, customer name, address,personal information and financial information are typically required topurchase hardware 704. Other information can also be collected through aquestionnaire or some form of incentive. Should customer information 708exist and consumer 702 is in good stead then generating customerinformation 708 is not required and the order process continues. Anyissue that occurs in checking customer information 708 will be broughtup for rectification to consumer 702. The hardware 710 that consumer 702selected is verified and place order 712 is performed.

Personalized sound management application software 706 is a suite ofapplications that consumer 702 selects for their specific needs. Oncecustomer information 708 has been established, consumer 708 is providedsubscription information 714. Use of personalized sound managementapplication software 706 is based on a periodic fee or subscription (forexample, a monthly fee). Subscription information 714 informs consumer702 as to the periodic subscription fees associated with the software706, terms of use, bundled packages of applications, and other pertinentinformation to complete the decision process. Should consumer 702approve of the terms, a contract 716 is provided to the customer toaccept or decline. A bill 718 is generated when an order is placedeither through purchasing hardware 710, accepting a subscription topersonalized sound management application software 706, or both. In atleast one exemplary embodiment, the purchase process is web basedallowing consumer 702 to purchase from a client system via acommunication path such as the internet or communication network.

FIG. 8 is a diagram illustrating registering a new device that includespersonalized sound management applications in accordance with at leastone exemplary embodiment. A new device or unit is received by a customer802. The manufacturer has loaded the preordered personalized soundmanagement applications chosen by customer 802 into the unit. Typically,customer 802 is going to want to try the unit shortly after receiving it(e.g., the unit is operational for a predetermined period of time 804,for example 1 week). In at least one exemplary embodiment, customer 802can try the unit for a predetermined time period 804. In general, thetime period 804 (for example, 15-30 minutes) is long enough for customer802 to get a feel for the unit but is not a useful length of time.Furthermore, the unit will notify customer 802 through a transducer onthe unit that they must register the device and that the unit will notbe usable after the predetermined time period. Note that in at least oneexemplary embodiment the customer would have the opportunity to democertain features (806) not purchased.

In at least one exemplary embodiment, a website 810 is a portal toregister the unit purchased by customer 802. Website 810 can have a webpage devoted to registering new devices to simplify the process.Customer 802 may log in (if an account already exists) or providepersonal information related to the registering process. A database 812is accessed that includes both customer and order information in one ormore databases. In at least one exemplary embodiment, the unit is incommunication with the device manufacturer server 814 through website810 or coupled thereto through a customer system.

Verification 816 verifies that all information is correct and that thereare no pending issues 818 with a corrective action identified. Theverification process 816 can checks things like device serial number,features and applications ordered by customer 802, personal/financialinformation. Once verification 816 is complete, it is determined at step817 whether to register the device. Step 817 proceeds to step 820 ifthere are no pending issues 818. Registration 820 registers the unit tothe owner after verification 816 is complete.

FIG. 9 is a diagram illustrating enabling a device in accordance with atleast one exemplary embodiment. In general, registration 902 linkscustomer information to a device as disclosed in FIG. 8. Theregistration process includes a comprehensive legally-compliant,state-specific Informed Consent system for collecting and storing theInformed Consent of users.

In at least one exemplary embodiment, the device will have at least onemicrophone. In the process of registration 902 the customer voice isrecorded by the device. The customer voice can be stored on the deviceand to the customer database. The customer voice can be used for anumber of applications including voice verification to use the devicethereby acting as a deterrent for others to use or steal the device.

As mentioned in FIG. 8 the unit or device can be enabled for apredetermined time period. Prior to enabling the new device, a contract904 is provided for customer review. The contract outlines the terms ofuse for using the device and that the product had been certified througha rigorous testing process. In at least one exemplary embodiment,liability coverage may be provided to the customer if the contract isaccepted. Having the liability coverage in conjunction with thecertification process is powerful in building consumer confidence aboutpersonalized sound management.

At step 905, it is determined whether the contract is accepted. The newdevice is not enabled 906 if the customer does not accept contract 904.The new device is enabled 908 if the customer accepts contract 904. Inat least one exemplary embodiment, the registration and enabling of theunit is through a client system coupled to the business server. Thus,the unit is enabled remotely.

FIG. 10 is a diagram illustrating updating a unit or device inaccordance with at least one exemplary embodiment. The device is enabledfor use. In general, instructions or an operational video may beprovided for a user to get acquainted with the device. Even with thishelp, a device may have so many features and applications that the usercould get overwhelmed or frustrated trying to understand and operate theunit. In some cases, a user may not want even try to learn how tooperate all the features and initially start out with the applicationthat provides significant utility to the user. The user may neveraddress learning how to use all the capabilities of the device.Moreover, misuse of a device can lead to dangerous operating conditionsthat could cause a serious or harmful situation.

Acclimation 1002 is a process to ensure that a user of a deviceappreciates the entire feature set but more particularly, enables thefeatures in a way that ensures proper usage in a safe and structuredmanner. In at least one exemplary embodiment, acclimation 1002 comprisestwo components, a learning module and a reminder module. The learningmodule is a system that “teaches” the user of the device the functionalcomponents of the device. In at least one exemplary embodiment, thelearning module may incorporate a learning system that evaluates theuser in the domain of a particular competency before certain functionsor features of the device are enabled. For example, features of thedevice are enabled sequentially, either automatically after the user hasutilized a particular function for a predetermined time (thereby showingcompetency in using the feature) or following a user competencyevaluation, which can be invoked either manually (when the user isconfident in using the feature) or automatically.

The reminder module may or may not be used in acclimation 1002. Thereminder serves to remind the user of the correct usage of features andalso serves to remind the user of other features on the device which theuser may not have used in a given time period. In at least one exemplaryembodiment an evaluation is invoked based on a predetermined timeperiod. The evaluation may be for a single function or feature or acombination of different functions. The predetermined time period beforeevaluating can vary depending on the function. Alternatively, theevaluation may be invoked based on a particular recent event, such as asoftware upgrade, or a detected change in user usage. If the user passesthe evaluation, the evaluation may be repeated, the relevant learningmode for the corresponding function to which the users competency wasevaluated may be repeated, or the corresponding function to which theusers competency was evaluated may be disabled. Thus, acclimation 1002allows a user to learn the device at a friendly pace, ensures that theuser does know how to use a feature, and protects the user from usingthe device in a manner that could be harmful.

The device can be coupled 1004 from a client system to the businessserver to update software on the device or purchase new hardware andsoftware. As disclosed hereinabove, the user information is checked todetermine if there are any issues that need to be rectified (e.g. missedpayment, user does not match to device, etc. . . . ). In the event thatthe issues cannot be rectified the device is disabled in a step 1006. Inat least one exemplary embodiment, the user information, device, andpersonalized sound management applications correlate. The server checksfor updates 1008 for the device and downloads updates to the device. Theuser goes through a similar process as described in FIGS. 7A-7B for ahardware or software purchase 1010 including agreeing to a contract tosubscribe and contract to terms of use as described in FIG. 9.

FIG. 11 is a diagram illustrating a device for implementing personalizedsound management in accordance with at least one exemplary embodiment.The device is generally indicated as an earpiece that partially seals orseals a user's ear canal 1124 and is constructed and operates inaccordance with at least one exemplary embodiment of the invention. Asillustrated, the earpiece comprises an electronic housing unit 1100 anda sealing unit 1108. The earpiece depicts an electro-acoustical assemblyfor an in-the-ear acoustic assembly, as it would typically be placed inan ear canal 1124 of a user 1130. The earpiece can be an in the earearpiece, behind the ear earpiece, receiver in the ear, partial-fitdevice, or any other suitable earpiece type. The earpiece can partiallyor fully occlude ear canal 1124, and is suitable for use with usershaving healthy or abnormal auditory functioning.

The earpiece includes an Ambient Sound Microphone (ASM) 1120 to captureambient sound, an Ear Canal Receiver (ECR) 1114 to deliver audio to anear canal 1124, and an Ear Canal Microphone (ECM) 1106 to capture andassess a sound exposure level within the ear canal 1124. The earpiececan partially or fully occlude the ear canal 1124 to provide variousdegrees of acoustic isolation. In at least one exemplary embodiment, theassembly is designed to be inserted into the user's ear canal 1124, andto form an acoustic seal with the walls of the ear canal 1124 at alocation between the entrance to the ear canal 1124 and the tympanicmembrane 1126 (or ear drum). In general, such a seal is typicallyachieved by means of a soft and compliant housing of sealing unit 1108.

Sealing unit 1108 is an acoustic barrier having a first sidecorresponding to ear canal 1124 and a second side corresponding to theambient environment. In at least one exemplary embodiment, sealing unit1108 includes an ear canal microphone tube 1112 and an ear canalreceiver tube 1110. Sealing unit 1108 creates a closed cavity ofapproximately 5 cc between the first side of sealing unit 1108 and thetympanic membrane 1126 in ear canal 1124. As a result of this sealing,the ECR (speaker) 1114 is able to generate a full range bass responsewhen reproducing sounds for the user. This seal also serves tosignificantly reduce the sound pressure level at the user's eardrum 1126resulting from the sound field at the entrance to the ear canal 1124.This seal is also a basis for a sound isolating performance of theelectro-acoustic assembly.

In at least one exemplary embodiment and in broader context, the secondside of sealing unit 1108 corresponds to the earpiece, electronichousing unit 1100, and ambient sound microphone 1120 that is exposed tothe ambient environment. Ambient sound microphone 1120 receives ambientsound from the ambient environment around the user.

Electronic housing unit 1100 houses system components such as amicroprocessor 1116, memory 1104, battery 1102, ECM 1106, ASM 1120, ECR1114, and user interface 1122. Microprocessor 1116 (or processor 1116)can be a logic circuit, a digital signal processor, controller, or thelike for performing calculations and operations for the earpiece.Microprocessor 1116 is operatively coupled to memory 1104, ECM 1106, ASM1120, ECR 1114, and user interface 1122. A wire 1118 provides anexternal connection to the earpiece. Battery 1102 powers the circuitsand transducers of the earpiece. Battery 1102 can be a rechargeable orreplaceable battery.

In at least one exemplary embodiment, electronic housing unit 1100 isadjacent to sealing unit 1108. Openings in electronic housing unit 1100receive ECM tube 1112 and ECR tube 1110 to respectively couple to ECM1106 and ECR 1114. ECR tube 1110 and ECM tube 1112 acoustically couplesignals to and from ear canal 1124. For example, ECR 1114 outputs anacoustic signal through ECR tube 1110 and into ear canal 1124 where itis received by the tympanic membrane 1126 of the user of the earpiece.Conversely, ECM 1106 receives an acoustic signal present in ear canal1124 though ECM tube 1112. All transducers shown can receive or transmitaudio signals to a processor 1116 that undertakes audio signalprocessing and provides a transceiver for audio via the wired (wire1118) or a wireless communication path.

The earpiece can actively monitor a sound pressure level both inside andoutside an ear canal 1124 and enhance spatial and timbral sound qualitywhile maintaining supervision to ensure safe sound reproduction levels.The earpiece in various embodiments can conduct listening tests, filtersounds in the environment, monitor warning sounds in the environment,present notification based on identified warning sounds, maintainconstant audio content to ambient sound levels, and filter sound inaccordance with a Personalized Hearing Level (PHL).

The earpiece can generate an Ear Canal Transfer Function (ECTF) to modelthe ear canal 1124 using ECR 1114 and ECM 1106, as well as an Outer EarCanal Transfer function (OETF) using ASM 1120. For instance, the ECR1114 can deliver an impulse within the ear canal 1124 and generate theECTF via cross correlation of the impulse with the impulse response ofthe ear canal 1124. The earpiece can also determine a sealing profilewith the user's ear to compensate for any leakage. It also includes aSound Pressure Level Dosimeter to estimate sound exposure and recoverytimes. This permits the earpiece to safely administer and monitor soundexposure to the ear.

In at least one exemplary embodiment, the earpiece has a number of sonicsignatures stored in memory. ASM 1120 is providing acoustic informationfrom the ambient environment to processor 1116. Processor 1116 analysesthe acoustic information for a sound similar to the sonic signature.Once identified, the earpiece will provide a response to the sound basedon the application. In a first exemplary embodiment, the earpiece willreduce music or telephone call (or the dominant source of sound beingprovided by the earpiece) and amplify the identified signal (ambulanceor police car) thereby notifying the user of the approaching vehicle. Ina second exemplary embodiment, the earpiece will tell the user (througha synthesized voice) that an ambulance or police car is approachingincluding the direction of the vehicle. The earpiece can also providethe identified signal with the voice warning. Other variations arepossible.

Conversely, the earpiece can perform the opposite operation. Theearpiece can identify a signal similar to the sonic signature and thenattenuate it before providing it through ECR 1114. For example, the userof the earpiece is a gun enthusiast. The user downloads a sonicsignature related to a gun shot. The earpiece upon identifying the soundof the gun shot would attenuate the portion of the acoustic informationprovided by ASM 1120 similar to the sonic signature of the gun shotwhile allowing other signals to come through. Thus, the user couldengage in a conversation at the gun range with the gun shot soundsattenuated while passing the conversation through the earpiece therebyprotecting his ear from the loud sounds in this environment and beingable to hear the conversation with more clarity.

In at least one exemplary embodiment, the earpiece can manually orautomatically record, measure sound pressure levels, attach metadata(including time stamp and geocode), and upload the information when acommunication path is present to a sound database. The earpiece iscapable of running personalized sound management software disclosedherein. Moreover, hardware ingredients such as the transducers (ECR1114, ASM 1120, and ECM 1106), processor 1116, and sealing unit 1108 areprovided to manufacturers as disclosed in FIG. 3 for allowing a varietyof companies to manufacture devices of their own earpiece designs. Itshould be noted that although an earpiece is used as an example of apersonalized sound management device the components can be used in othercommunication devices and sound devices to personalize control of thesound.

In at least one exemplary embodiment, sealing section 1108 is areplaceable unit. Sealing section 1108 can pull out and be replaced as aunit. Sealing section 1108 performance can degrade over time due toparticulate build up. There may also be sanitary or health reasons forreplacing sealing section 1108 periodically. In at least one exemplaryembodiment, sealing section 1108 replacement parts can be provided aspart of a periodic subscription fee to a user, purchased over thecounter in a store, or purchased through a web environment.

FIG. 12 is a block diagram of a device for implementing personalizedsound management in accordance with at least one exemplary embodiment. Apower supply 1205 powers components of the earpiece includingmicroprocessor/DSP 1206 (or processor 1206) and a data communicationsystem 1216. As illustrated, the earpiece can include the processor 1206operatively coupled through a data communication system 1216 to an ASM1210, an ECR 1212, and ECM 1208. Data communication system 1216 caninclude one or more Analog to Digital Converters and Digital to AnalogConverters (DAC). The processor 1206 can utilize computing technologiessuch as a microprocessor, Application Specific Integrated Chip (ASIC),and/or digital signal processor (DSP) with associated Random AccessMemory (RAM) 1202 and Read Only Memory 1204. Other memory types such asFlash, non-volatile memory, SRAM, DRAM or other like technologies can beused for storage with processor 1206. The processor 1206 can alsoinclude a clock to record a time stamp.

In general, a data communication system 1216 is a communication pathwayto components of the earpiece and components external to the earpiece.The communication link can be wired or wireless. In at least oneexemplary embodiment, data communication system 1216 is configured tocommunicate with ECM assembly 1208, ASM assembly 1210, visual display1218, and user control interface 1214 of the earpiece. As shown, usercontrol interface 1214 can be wired or wirelessly connected. In at leastone exemplary embodiment, data communication system 1216 is capable ofcommunication to devices exterior to the earpiece such as the user'smobile phone 1232, a second earpiece 1222, and a portable media player1228. Portable media player 1228 can be controlled by a manual usercontrol 1230.

The user's mobile phone includes a mobile phone 1232 communicationsystem 1224. A microprocessor 1226 is operatively coupled to mobilephone communication system 1224. As illustrated multiple devices can bewirelessly connected to one another such as an earpiece 1220 worn byanother person to the user's mobile phone 1232. Similarly, the user'smobile phone 1232 can be connected to the data communication system 1216of the earpiece as well as the second earpiece 1222. This connectionwould allow one or more people to listen and respond to a call on theuser's mobile phone 1232 through their respective earpieces.

As illustrated, a data communication system 1216 can include a voiceoperated control (VOX) module to provide voice control to one or moresubsystems, such as a voice recognition system, a voice dictationsystem, a voice recorder, or any other voice related processor. The VOXmodule can also serve as a switch to indicate to the subsystem apresence of spoken voice and a voice activity level of the spoken voice.The VOX can be a hardware component implemented by discrete or analogelectronic components or a software component. In one arrangement, theprocessor 1206 can provide functionality of the VOX by way of software,such as program code, assembly language, or machine language.

ROM 1204 can be used to store personalized sound management applicationsto minimize the possibility of modification and tampering of the code.The RAM 1202 can also store program instructions for execution on theprocessor 1206 as well as captured audio processing data. For instance,memory RAM 1202 and ROM 1204 can be off-chip and external to theprocessor 1206 and include a data buffer to temporarily capture theambient sound and the internal sound, and a storage memory to save fromthe data buffer the recent portion of the history in a compressed formatresponsive to a directive by the processor. The data buffer can be acircular buffer that temporarily stores audio sound at a current timepoint to a previous time point. It should also be noted that the databuffer can in one configuration reside on the processor 1206 to providehigh speed data access. The storage memory can be non-volatile memorysuch as SRAM to store captured or compressed audio data. Thenon-volatile memory could also be used to store sonic signatures.

Data communication system 1216 can include an audio interfaceoperatively coupled to the processor 1206 and the VOX to receive audiocontent, for example from portable media player 1228, cell phone 1232,or any other communication device, and deliver the audio content to theprocessor 1206. The processor 1206 responsive to detectingvoice-operated events from the VOX can adjust the audio contentdelivered to the ear canal of the user of the earpiece. For instance,the processor 1206 (or the VOX of data communication system 1216) canlower a volume of the audio content responsive to detecting an eventsuch as a sonic signature for transmitting the acute sound to the earcanal of the user. The processor 1206 by way of the ECM 1208 can alsoactively monitor the sound exposure level inside the ear canal andadjust the audio to within a safe and subjectively optimized listeninglevel range based on voice operating decisions made by the VOX of datacommunication system 1216.

The earpiece and data communication system 1216 can further include atransceiver that can support singly or in combination any number ofwireless access technologies including without limitation Bluetooth™,Wireless Fidelity (WiFi), Worldwide Interoperability for MicrowaveAccess (WiMAX), and/or other short or long range communicationprotocols. The transceiver can also provide support for dynamicdownloading and uploading over-the-air to the earpiece. It should benoted also that next generation access technologies also can be appliedto the present disclosure.

Data communication system 1216 can also include a location receiver thatutilizes common technology such as a common GPS (Global PositioningSystem) receiver that can intercept satellite signals and therefromdetermine a location fix of the earpiece and provide a geocode as anidentifier for a recording or measurement such as sound pressure level.

The power supply 1205 can utilize common power management technologiessuch as replaceable batteries, supply regulation technologies, andcharging system technologies for supplying energy to the components ofthe earpiece and to facilitate portable applications. A motor (notshown) can be a single supply motor driver coupled to the power supply1205 to improve sensory input via haptic vibration. As an example, theprocessor 1206 can direct the motor to vibrate responsive to an action,such as a detection of a warning sound or an incoming voice call.

The earpiece can further represent a single operational device or afamily of devices configured in a master-slave arrangement, for example,a mobile device and an earpiece. In the latter embodiment, thecomponents of the earpiece can be reused in different form factors forthe master and slave devices.

FIG. 13 is a diagram of a communication device 1302 or earpiece 1310configured to provide sonic signatures to sonic signature database 1308in accordance with at least one exemplary embodiment. Collecting a largenumber of sounds around the world is a daunting task. As mentionedpreviously, no group or business entity would have the ability toacoustically map the world on a continuous basis. In at least oneexemplary embodiment, the collection of sonic signatures is achieved bymobilizing as many people as possible by making it simple to capture andprovide a sound for sonic signature database 1308. This is achieved byadapting a common device having a potential of reaching billions ofpeople for manually or automatically capturing sonic signatures andproviding them to database 1308.

In at least one exemplary embodiment, communication device 1302 is amobile communication device having a microphone for receiving sound.Examples of a communication device 1302 are a phone, cell phone, PDA,computer, two way radio, smart phone, and earpiece. Earpiece 1310includes a microphone for capturing sound and the circuitry disclosed inFIG. 12. Earpiece 1310 is operably configured for recording sound andmeasuring sound pressure levels. The acoustic information received fromthe microphone of earpiece 1310 is recorded to memory residing inearpiece 1310 and tagged with metadata including a time stamp andgeocode. The sound pressure level (SPL) is measured from the microphonesignal through analog or digital signal processing typically before anyaudio processing occurs within earpiece 1310. The SPL measurement ofthis recorded event is associated to the stored recording and metadata.Similarly, communication device 1302 is adapted for capturing sound 1312including recording, measuring sound pressure level, storing, andtagging with metadata (including a time stamp and geocode). In at leastone embodiment, communication device 1302 could have additionalcircuitry similar to that in FIG. 12 in the device specifically forgenerating a sonic signature database. Alternately, the circuitry withincommunication device 1302 can be adapted for recording sound andmeasuring sound pressure level. In particular, mechanical aspects of thecommunication device such as microphone placement, microphone porting,as well as electronic audio processing (automatic gain control,equalization, etc. . . . ) is taken into account for ensuring anaccurate sound pressure level measurement and recording.

In at least one exemplary embodiment, a user having communication device1302 manually or automatically captures and provides a sonic signatureto a sonic signature database 1308. For example, a microphone oncommunication device 1302 is always enabled for receiving sound. Thesound can be stored in a buffer. The sound in the buffer is analyzed andbased on a variety of criteria can be configured to be provided todatabase 1308. For example, criteria such as sound pressure level, time,frequency of sound, geographic location, or recognition of a sound(sonic signature detection) are but a few of the parameters that couldbe used to determine that the sound in the buffer is worthy of saving.Metadata is automatically attached such as a time stamp and geocode butthe user can also add information. In at least one exemplary embodiment,a communication path 1304 is opened and a link is made to website 1306and more particularly to database 1308 where the stored sounds can beautomatically uploaded. In at least one exemplary embodiment, the sonicsignature, sound pressure level, and metadata could be immediately sentif a communication path 1304 is available to save memory. Furthercommunication between website 1308 and the user of communication device1302 or earpiece 1310 can take place to edit, identify, describe, andformat the provided sound 1312 at a more convenient time. It should benoted that video information that includes audio information can also beprovided in similar fashion as disclosed hereinabove. The audioinformation from the video can be used for sonic signature database1308.

Earpiece 1310 and communication device 1302 can be operably coupledtogether. A priority could be set up such that earpiece 1310 is theprimary recorder of sound 1312 when enabled by the user. Earpiece 1310can be used with other devices for example a portable media player.Earpiece 1310 can automatically or manually record, measure SPL, and tagmetadata of sound 1312 as described hereinabove. The sonic signaturesstored in earpiece 1310 could be sent to website 1306 and sonicsignature database 1308 if earpiece 1310 is coupled to a communicationpath 1304 or through another device to which it is operably coupled thathas a communication path. Alternately, the sonic signatures could beuploaded via website 1306 and sonic signature database 1308 at a moreconvenient time, for example a wired or wireless link to the user'spersonal computer at home, allowing the user to also provide additionalmetadata before providing the information. Thus, a common device hasbeen provided that is adapted for capturing, storing, measuring SPL,adding metadata including a time stamp and geocode, and uploading theacoustic information to a database thereby including the broadest numberof people across the largest geographic area for sound collection on acontinuous basis.

FIG. 14 is a block diagram illustrating a cell phone 1404 capturing asonic signature and providing the sonic signature to a database ofsounds 1418 in accordance with at least one exemplary embodiment. Cellphone 1404 is enabled for capturing a sonic signature via an exclusivebutton or through an automatic process. In at least one exemplaryembodiment, the user can select whether a sound is recorded, a soundpressure level measurement is recorded, or both are acquired. A defaultcan be that both are acquired automatically.

A sound 1402 is received by a microphone on cell phone 1404 and storedin a buffer in a record sounds step 1406. The sound in the buffer isanalyzed and determined to be saved. The sound pressure level (SPL) ofthe sonic signature is measured or calculated in a measure SPL step1408. The user can also manually enter metadata 1410 via a keyboard to ametadata table or can enter vocal description in an attached audiostream. Metadata 1410 includes a time stamp and a geocode correspondingto the sonic signature.

In at least one exemplary embodiment, the sonic signature, soundpressure level, and metadata can be stored in memory 1412 that resideson cell phone 1404. A queue of sonic signatures 1414 can be stored inmemory 1412 for uploading at an appropriate time. The user can initiateuploading of the queue of sonic signatures 1414 to database of sounds1418 when a communication path is completed. In at least one exemplaryembodiment, cell phone 1404 can automatically connect 1416 to servers indatabase of sounds 1418 and upload queue of sonic signatures 1414 when acommunication path is enabled. Although stored on database of sounds1418, there may be an iterative process to determine if the sonicsignatures are in the correct format or are unique enough to bepermanently stored. Thus, a large database of sounds 1418 can becollected world wide by an automatic process using a common device suchas a cell phone that could not be accomplished by direct means. In atleast one exemplary embodiment, the database of sounds 1418 is used inconjunction with personalized sound management applications configuredto provide sonic signatures for identifying and providing a response tothe identified sound.

To encourage retailers to actively engage and participate in sellingHearium Labs branded products, a business model has been developed basedon an annuity revenue sharing methodology. Through this patent pendingapproach, for the first time, retailers, operators and other supplierswill be able to carry a single audio earpiece or other device in theirstores that can be sold to a wide and deep range of consumers. Utilizingan “iPod/iTunes” approach, suppliers will earn profit off the sale ofthe hardware in store and Personalized Sound Management applications atand after the point of sale. As the consumer continues to personalizetheir earpiece or device over time, the supplier will earn residuals ofup to 50% of the application revenues through a co-operative sharingprogram between them and Hearium Labs.

To accomplish this, Hearium Labs has enabled the hardware solution towork off of a webified environment that is being architected withcommercial flexibility for consumer driven point of sale purchase andactivation. This approach allows for the Personalized Sound Managementapplications to be remotely downloaded and activated on the hardwarethrough any Internet equipped PC and web-based browser. Consumers willthus be able to “enhance” their devices by adding both purchased andsubscription applications and personalize their experience withtechnology designed to acclimate devices to the wearer and theirenvironment.

In general, a process has been provided that eliminates barriers formass adoption of a new technology. The result is that the technology canbe provided by a number of manufacturers thereby having ubiquitousavailability at release. Universal compatibility is also provided byusing the same hardware and software in each new product havingpersonalized sound management. Certification ensures that each device ismanufacturable and performs to specification. Manufacturers andconsumers benefit because liability coverage may be provided. Consumerscan adapt to the technology rapidly through an acclimation process.

While the present invention has been described with reference toexemplary embodiments, it is to be understood that the invention is notlimited to the disclosed exemplary embodiments. The scope of thefollowing claims is to be accorded the broadest interpretation so as toencompass all such modifications and equivalent structures andfunctions.

1. An earpiece comprising: a sealing unit; a first microphone generatinga first signal, wherein the first microphone is configured to measure afirst acoustic environment; a second microphone generating a secondsignal, wherein the second microphone is configured to measure a secondacoustic environment, wherein the second acoustic environment is closerto a user's ear canal than the first acoustic environment; a speaker; amemory that stores instructions; a circular buffer, where the circularbuffer is configured to store a portion of at least one of the firstsignal, the second signal or a combination thereof, generating datastored in the circular buffer; and a microprocessor, wherein themicroprocessor is operatively connected to the first microphone, thesecond microphone, the speaker, the circular buffer, and the memory,wherein the microprocessor is configured to execute the instructions toperform operations comprising: sending an audio content signal to thespeaker; analyzing the data to detect an event; and reducing a volume ofthe audio content signal, for a predetermined time period, when theevent is detected, wherein during the predetermined time period themicroprocessor is still analyzing the data to detect a second event. 2.The earpiece according to claim 1, wherein the event is a user's voice.3. The earpiece according to claim 1, wherein the event is a voice. 4.The earpiece according to claim 2, wherein the sound level of the audiocontent is reduced for a predetermined time period after the detectionof a user's voice.
 5. The earpiece according to claim 4, where thepredetermined time period is selected by the user.
 6. The earpieceaccording to claim 1, where the event is an emergency event.
 7. Theearpiece according to claim 6, where the emergency event is at least oneof a siren, an emergency sound, or an alarm or a combination of these.8. The earpiece according to 1, wherein detecting an event compares thedata to a sonic signature stored in the memory.
 9. The earpieceaccording to claim 8, wherein the event is detected when the comparisonindicates that the data is within a threshold value of the sonicsignature.
 10. The earpiece according to claim 1, where the firstmicrophone is an ambient sound microphone.
 11. The earpiece according toclaim 10, where the second microphone is a second ambient soundmicrophone.
 12. The earpiece according to claim 10, where the secondmicrophone is an ear canal microphone.
 13. The earpiece according toclaim 5, where the predetermined time period is the time after which nofurther user voice is detected.
 14. The earpiece according to claim 13,wherein the first microphone is an ambient sound microphone.
 15. Theearpiece according to claim 14, where the second microphone is a secondambient sound microphone.
 16. The earpiece according to claim 14, wherethe second microphone is an ear canal microphone.
 17. The earpieceaccording to claim 13, where the user selects the predetermined timeperiod using a user control interface on a communication device.